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Abstract — This  paper  presents  an  efficient  algorithm  for 
solving  restoration  problem  in  the  frame-based  image 
restoration.  In  image  restoration,  the  patch-based 
approach  has  been  used  for  better  results  without 
degrading  the  image.  Our  proposed  procedure  for  solving 
the  stable  optimal  problem  is  based  on  a patched  group 
strategy  method.  In  this  paper  GSR  ( Group  Based  Sparse 
Representation ) algorithm  is  proposed  which  is  based  on 
concept  that  group  of  patches  are  constructed  which 
maintains  the  relationship  among  various  patches  of 
images  and  it  is  implemented  for  three  image  restoration 
problems  i.e.  DE  noising,  DE  blurring  and  Image 
enhancement.  Various  parameters  are  taken  into  account 
like  PSNR,  SSIM,  speed  and  time.  The  simulation 
experiments  have  been  conducted  in  MATLAB  and  the 
results  have  been  compared  with  existing  scheme  i.e. 
patch  based  sparse  representation.  Both  standard  and 
real  time  images  have  been  included  in  simulation.  It  has 
been  observed  that  after  the  reconstruction  of  an  image 
values  of  parameters  are  increased  which  are  more  than 
existing  scheme. 

Keywords — Analysis-based  approach , Group-based 
patches , Image  enhancement , Image  Restoration,  Patch 
method. 

I.  INTRODUCTION 

Image  restoration  may  be  declared  as  method  within 
which  the  prime  quality  image  is  fixed  up  from  the 
degraded  caliber  image.  It  is  an  associate  degree  operation 
within  which  a corrupt/noisy  image  is  taken  and  also  the 
clean,  original  image  is  calculated.  Corruption  could  take 
several  forms  like  camera  miscues,  part  turbulence  and 
camera  or  object  motion  etc.  In  image  restoration  the 
transpose  operations  of  activity  is  done  which  produces 
blur  in  the  image  to  get  the  original  image  back.  The 
information  that  is  corrupted  due  to  blurring  can  be  get 
back  with  the  help  of  Point  Spread  Function  (PSF). 

Image  restoration  and  image  improvement  each  area  unit 
completely  different  in  sense  that  the  latter  is  meant  to 
emphasize  varied  options  of  the  image  so  as  to  supply  the 
additional  pleasing  image  to  the  observer. 

Noise  will  effectively  be  removed  by  ignoring  some 
resolution  in  image  improvement.  However  this  can  be 
not  acceptable  in  several  applications  like  during  a visible 


radiation  magnifier,  resolution  within  the  z-direction  is 
dangerous.  Image  restoration  techniques  are  area  unit 
enforced  with  objective  of  reducing  noise  and 
convalescent  resolution  loss.  These  techniques  area  unit 
performed  in  2 domains  either  within  the  image  domain 
or  the  frequency  domain.  In  American  state  convolution 
technique  noise  is  absent  which  the  blurring  method  is 
shift-invariant  and  therefore  it  introduces  additional  subtle 
techniques  to  manage  the  various  varieties  of  noises  and 
blurring  functions. 

Applications  of  Image  restoration 

• Denoising  and  artifacts  removal 

• Sharpness,  contrast  and  resolution  enhancement 

• In  medical  images  (CT,  MRI,  ultrasound,  etc.) 

• HD/3D/mobile  displays,  web-scale  data,  legacy 
materials  etc. 

DE  noising  Techniques 

When  the  only  degradation  present  in  an  image  is  noise, 
then  equation  becomes 

g(x,  y)  = f(x,  y)  + n(x,  y)  (1) 

And,  G(u,  v)  = F(u,  v)  + N(u,  v)  (2) 

DE  noising  techniques  exist  in  each  spatial  domain  in 
addition  as  frequency  domain. 

Spatial  Filtering:  Spatial  filtering  is  most  popular  once 
solely  additive  noise  is  gift.  The  different  categories  of 
filtering  techniques  exist  in  spatial  domain  filtering. 
During  this  technique,  the  center  pixel  worth  of  the  filter 
window  is  replaced  with  the  first  moment  of  all  the  pixel 
values  among  the  filter  window.  Noise  is  reduced  as 
results  of  this  smoothening  however  edges  among  the 
image  get  blurred. 

Median  Filter:  Median  filter  belongs  to  the  category  of 
order-statistics  filters.  The  ordering  of  pixels  contained 
within  the  filter  window  is  that  the  response  of  those 
filters.  Median  filter  replaces  the  worth  of  a pixel  by  the 
median  of  the  grey  levels  among  the  filter  window. 
Adaptive  Filter:  For  the  removal  of  impulse  noise  from 
an  image  the  adaptive  filtering  uses  the  gray  and  color 
space.  Gray  and  color  space  is  the  base  for  the  whole 
processing  in  adaptive  filtering.  Best  noise  prevention 
results  can  be  provided  by  it  and  better  preserve  thin  lines, 
the  image  edges  and  the  image  details.  As  compared  to 
other  filters  it  provides  better  image  quality. 
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II.  PREVIOUS  FINDINGS 

Guo  and  An  [1]  have  presented  a brand  new  restoration 
algorithmic  rule  that  implements  the  filling  of  broken 
region  with  morphological  erosion  and  propagates 
structure/texture  options  of  the  best-known  region  into  the 
broken  region  with  exemplar-based  texture  synthesis.  The 
strategy  will  retain  the  continuity  of  image  isopods 
between  the  best-known  region  and  therefore,  the  repaired 
broken  region,  and  output  an  entire,  natural  looking 
image.  Through  comparative  experiments  with  some 
existing  ways,  we  tend  to  demonstrate  the  effectiveness  of 
the  algorithmic  rule  in  removing  giant  objects  similarly  as 
skinny  scratches. 

Zhang  et  al.  [2]  have  proposed  fuzzy  genetic  algorithmic 
rule  (FGA)  on  the  premise  of  genetic  algorithmic  rule. 
Uncertainty  issues  may  be  resolved  within  the  method  of 
image  process  by  constructing  fuzzy  characteristic  matrix 
and  fuzzy  fitness  perform,  and  victimization  fuzzy  genetic 
improvement  technique.  Huan  et  al.  [3]  have  proposed 
Associate  in  Nursing  economical  image  in  painting 
algorithmic  rule  by  introducing  vital  aspects  and 
enhancements  admire  the  filling  order  of  the  pixels  within 
the  target  region  and  texture  synthesis  in  an  exceedingly 
dynamic  looking  vary.  The  algorithmic  rule  is  easy  to 
implement  and  restores  the  target  regions  with  visually 
plausible  quality  i.e.  higher  than  many  existing  ways  with 
a lower  execution  price. 

Wang  et  al.  [4]  have  presented  a unique  image  super- 
resolution technique  supported  learning  the  distributed 
association  between  input  image  patches  and  therefore, 
the  example  image  patches.  We  tend  to  improve 
Associate  in  Nursing  existing  distributed-coding 
algorithmic  rule  to  search  out  sparse  association  between 
image  patches.  Dharmarajan  and  Kannan  [5]  have 
designed  an  algorithm  for  the  hypergraph  (HG) 
representation  of  an  image,  subsequent  detection  of  Salt 
and  Pepper  (SP)  noise  in  the  image  and  finally  the 
restoration  of  the  image  from  this  noise.  The  proposed 
algorithm  exhibits  superiority  over  traditional  algorithms 
and  recently  proposed  ones  in  terms  of  visual  quality, 
Peak  Signal  to  Noise  Ratio  (PSNR)  and  Mean  Absolute 
Error  (MAE). 

Yang  et  al.  [6]  have  introduced  the  concept  of  examples- 
aided  redundant  dictionary  learning  into  the  single -image 
super-resolution  reconstruction,  and  have  proposed 
multiple  dictionaries  learning  scheme  inspired  by 
multitask  learning,  in  order  to  avoid  a large  training 
patches  database  and  obtain  more  accurate  recovery  of 
HR  images.  Chen  et  al.  [7]  have  designed  a new  sparsity- 
based  algorithm  for  the  classification  of  hyper  spectral 
imagery.  The  proposed  algorithm  relies  on  the 
observation  that  a hyper  spectral  pixel  can  be  sparsely 
represented  by  a linear  combination  of  a few  training 
samples  from  a structured  dictionary.  Giannoula  et  al.[8] 


have  proposed,  the  blind  restoration  of  a scene,  when 
multiple  degraded  (blurred  and  noisy)  acquisitions  are 
available.  An  adaptive  filtering  technique  is  proposed, 
where  the  distorted  images  are  filtered,  classified  and  then 
fused  based  upon  the  classification  decisions. 

III.  PROPOSED  WORK 

The  objective  of  image  restoration  technique  is  to  scale 
back  noise  and  recover  resolution  loss.  Image  processing 
techniques  are  performed  either  within  the  image  domain 
or  the  frequency  domain.  The  most  common  and  simple 
technique  for  image  restoration  is  DE  Convolution,  that  is 
performed  within  the  frequency  domains.  DE  convolution 
technique  because  of  its  direct  inversion  of  PSF  amplifies 
noise  and  creates  the  resulting  image  which  is  imperfectly 
deblurred.  Therefore,  additional  subtle  techniques  are 
developed  to  recover  the  various  forms  of  noises  and 
blurring  functions. 

Image  processing  uses  various  kinds  of  filtering 
techniques  like  Median  filtering,  Linear  Filtering  and 
adaptation  Filtering  etc  to  view  a picture  to  its  original 
forms. 

Operations  on  original  images 

Now  for  restoring  the  image  which  is  approximately 
similar  to  original  image  from  the  degraded  image  we 
have  to  perform  following  operations  on  degraded  image. 


Fig.l : Operations  on  original  image 


1.  Group  Construction 

The  group  construction  is  carried  out  by  following  the 
steps  described  below: 

Step  1 : Divide  the  image  x with  size  N into  n overlapped 
patches  of  size  -Jb^  X and  each  patch  is  denoted  by 
the  vector  xk  E M,Bs  i.e.,  where  k = 1,2  . . .,  n. 

Step  2:  For  each  patch  xk  within  the  training  window  of 
size  L x L,  search  its  c best  matched  patches  which 
contain  the  set  SXk  . Euclidian  distance  is  used  to  find  out 
the  similarity  between  the  different  patches. 

Step  3:  All  the  patches  in  the  set  SXk  are  put  into  a matrix 
of  siz eBs  X c,  denoted  by  xGr  E M5sXC,  which  includes 
every  patch  in  SXk  as  its  columns,  i.e.,  xGk  = 
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main  diagonal  and  uGr 0.,  i7Gfe0.are  the  columns  of 
UCKmd  VGk. 


{xG]c®i,  xGk®2,...,  xGk®C] . The  matrix  xGr  is  called  as 
group.  This  can  be  represented  by  equation  as: 

*Gk  = RGk(?0  (3) 

Where,  RGk  (.)  is  the  operator  which  is  used  to  extract  the 
group  xGfefrom  x,  and  its  transpose,  RT Gk(.),  can  put  back 
a group  into  its  kth  position  in  the  reconstructed  image, 
padded  with  zeros  elsewhere.  Thus  one  can  recover  whole 
image  x from  {xGk } become: 

* = Z2=i«Sk(*6J-/IJ[=i^k(W)  W 

Where,  ./  represents  element-wise  division  of  the  two 
vectors  and  l#5xC  represents  matrix  of  size  Bs  x c with 
all  element  being  1 . 

2.  Group -Based  Sparse  Representation  Modeling 

The  GSR  model  assumes  that  by  using  few  atoms  of  the 
self-adaptive  learning  dictionary  DGk  each  group  xGfecan 
be  represented  accurately.  Thus, 

Dck  = {dG]c®u  dGk® 2,..,  dGk® m}  is  supposed  to  be  known. 
DGk  is  of  size  ( Bs  x c)  x m , that  is,  DGk  E MSBsxOxrnm 
The  rationale  behind  the  sparse  coding  process  of  every 
group  is  to  seek  sparse  vector  aG]c=  [ocGmi,  aGkm 

’ 

such  that,  xGk  = dGmi  . For  simplicity  here 

DGk*ck is  used  t0  represents  « Gk 0i  dGmv 

After  this,  the  whole  image  can  be  sparsely  represented 
by  the  {aG/c}  that  is  the  set  of  the  sparse  codes.  Thus,  x 
can  be  constructed  from  { aGk } which  can  be  represented 
by 

X = DG°aG  = Yk=l^Gk(^GkaGk)  '/Tik=l^Gk  (l£SxC)  (5) 
Where  DG  denotes  the  concatenation  of  all  DGk , and  aG 
denotes  the  concatenation  of  all  aGk . 

3.  Self-Adaptive  Group  Dictionary  Learning 

While  learning  the  dictionary  for  each  group  following 
points  must  be  considered. 

1)  Computational  cost  must  be  minimized. 

2)  The  learnt  dictionary  must  be  adaptive  for  a group  that 
is  all  the  groups  {xG/c}are  represented  by  the  same 
dictionary  DGk . 

3)  It  must  consider  the  characteristics  of  each  group  xGk , 
containing  the  patches  with  similar  patterns. 

The  adaptive  dictionary  for  each  group  is  directly  learnt 
from  its  estimate  rawhich  is  naturally  selected  in  the 
process  of  optimization.  After  obtaining  rGk,  apply  SVD. 
This  can  be  formulated  as  follows: 

rGk  = VGKY,GkVTGk  = Y?=1yrCk0l  (6) 

Where,  yrGfc  = [y^;  YrCk( ^ ■■■;  YrGk0J  Zak  = 
diag(yrGk)  is  a diagonal  matrix  with  elements  on  its 


For  the  group  xGv  each  atom  in  dictionary  DGk  is  defined 
as, 

dGk®i  = uGm.  vlm.  , i =1,  2 , m,  (7) 

Where,  dGk® { E RBsXC  . Thus,  the  learned  dictionary  for 
the  group  xGk  is  given  by: 

D Gk  ~ \.dGk® i9  dGk® 2,..,  dGk® m]  (8) 

Operations  on  degraded  image 

Now  for  restoring  the  image  which  is  approximately 
similar  to  original  image  from  the  degraded  image  we 
have  to  perform  following  operations  on  degraded  image. 


Fig. 2:  Operations  on  degraded  image 


1.  Group  Construction 

Similar  procedure  which  we  applied  on  original  image  for 
group  construction  is  carried  out  on  degraded  images  too 
and  the  groups  are  constructed. 

2.  Group  Matching  and  Group  Replacement 

In  group  matching  the  constructed  group  of  degraded 
image  is  compared  and  matched  with  the  constructed 
group  of  original  image.  After  the  group  is  matched  the 
group  of  degraded  image  is  replaced  with  the  group  of 
original  image. 

3.  Restored  Image 

After  replacing  all  the  groups  of  the  degraded  image  we 
get  the  restored  image  which  is  approximately  similar  to 
the  original  image. 

IV.  EXPERIMENATL  RESULTS 

The  datasets  has  been  obtained  from  controlled  forms. 
The  controlled  dataset  has  been  obtained  on  the  similar 
background,  which  may  offer  the  utmost  accuracy.  The 
information  collected  within  the  ideal  conditions  has  well- 
tried  to  be  the  foremost  economical  information  in  terms 
of  accuracy.  The  controlled  information  has  been 
collected  from  the  assorted  objects  (persons). 
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Fig. 3:  Test  Images  (a)  House  (b)  Cameraman  (c) 
Vegetables 
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Fig  A:  SSIM  values  on  a graph  for  no.  of  iterations 


Performance  Evaluation  Parameters 
SSIM:  SSIM  is  used  for  measuring  the  similarity  between 
two  images.  Structural  information  is  the  idea  that  the 
pixels  have  strong  inter-dependencies  especially  when 
they  are  spatially  close.  These  dependencies  carry 
important  information  about  the  structure  of  the  objects  in 
the  visual  scene. 

PSNR:  Peak  signal-to-noise  ratio  is  an  engineering  term 
for  the  ratio  between  the  maximum  possible  power  of  a 
signal  and  the  power  of  corrupting  noise  that  affects  the 
fidelity  of  its  representation.  Because  many  signals  have  a 
very  wide  dynamic  range,  PSNR  is  usually  expressed  in 
terms  of  the  logarithmic  decibel  scale.  Although  a higher 
PSNR  generally  indicates  that  the  reconstruction  is  of 
higher  quality,  in  some  cases  it  may  not. 

MSE:  In  statistics,  the  mean  squared  error  (MSE)  or 
mean  squared  deviation  (MSD)  of  an  estimator  measures 
the  average  of  the  squares  of  the  errors  or  deviations,  that 
is,  the  difference  between  the  estimator  and  what  is 
estimated. 

Evaluation  measures  for  Denoising 


(b)  PSNR 

PSNR  values  are  evaluated  for  both  existing  method  and 
proposed  method.  Average  values  are  obtained  with 
different  sigma  values. 


Table. 2:  PSNR  values  in  MS-EPLL 


Sigma 

MS-EPLL 
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29.01 
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Figure.  5 Different  values  of  PSNR  for  different  values  of 
sigma. 


(a)SSIM 

De-noising  has  been  tested  for  12  Images  from  standard 
dataset  used  in  existing  scheme.  The  average  SSIM  value 
has  been  taken  from  all  12  images.  Final  Values  are 
shown  with  the  line  increasing  upwards. 


Table.  1:  SSIM  measures 


Sr. 

SSIM 

1 

0.1787 

2 

1.5416 

3 

1.7087 

4 

1.7644 

5 

1.8754 

6 

1.8773 

De-noising  has  been  tested  for  12  Images  from  standard 
dataset  used  in  existing  scheme.  The  average  PSNR  value 
has  been  taken  from  all  12  images.  This  graph  shows  the 
average  PSNR  values  for  corresponding  values  of  sigma. 


Table.  3:  PSNR  values  in  GSR 


Sigma 

GSR 

15 

34 

25 

32 

50 

28 

100 

25.6 
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Fig.  6:  Different  values  of  P SNR  for  different  values  of 
sigma. 


De-noising  has  been  tested  for  12  Images  from  standard 
dataset  used  in  existing  scheme.  The  average  PSNR  value 
has  been  taken  from  all  12  images.  This  graph  shows  the 
average  PSNR  values  for  corresponding  values  of  sigma. 
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Fig.  7:  comparison  of  PSNR  values  for  existing  and 
proposed  method 

There  is  comparison  between  results  of  existing  and 
proposed  algorithm  namely,  GSR  and  MS-EPLL  for 
average  PSNR  in  De-noising  process  with  different  sigma 
values.  De-noising  has  been  tested  for  12  Images  from 
standard  dataset  used  in  existing  scheme.  The  average 
PSNR  value  has  been  taken  from  all  12  images.  Final 
Values  has  been  compared  with  existing  scheme. 
Proposed  model  shows  the  better  results  in  comparison  of 
existing  scheme. 

(C)  SPEED 

This  graph  shows  how  much  speed  is  measured  while 
implementing  GSR  algorithm  during  noise  removal. 


Speed  during  .Noise  Removal 


■ Speed  during 
Noise  Removal 


Fig. 8:  Average  Speed  for  different  images 
(d)  TIME 

The  graph  below  sows  time  taken  while  implementing 
GSR  algorithm  for  Noise  removal. 
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Fig.  9:  Time  taken  for  different  images 

Evaluation  Measures  for  Image  Enhancement 

Image  Enhancement  has  been  tested  on  12  Images  from 
standard  dataset  used  in  existing  scheme.  The  average 
PSNR  value  has  been  taken  from  all  12  images.  Final 
Values  has  been  compared  with  existing  scheme. 
Proposed  model  shows  the  better  results  in  comparison  of 
existing  scheme. 

(a)  PSNR 


PSNR  for  enhancing  image 


50 


Image  data 

Fig.  10:  Average  PSNR  for  different  images 

This  graph  shows  the  average  PSNR  value  while 
enhancing  image  for  different  images  selected  from 
standard  dataset. 

(b)  MSE 

Image  Enhancement  has  been  tested  on  12  Images  from 
standard  dataset  used  in  existing  scheme.  The  average 
MSE  value  has  been  taken  from  all  12  images.  It  shows 
better  results  in  proposed  algorithm. 


MSE  fur  enhancing  image 
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Fig.  11 : Average  MSE  for  different  images 
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(C) SPEED 


Speed  for  enhancing  image 
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Fig.  12:  Average  speed  for  different  images 


Fig.  15 : Average  PSNR  values  for  different  images  in 
proposed  system 


This  graph  shows  how  much  speed  is  measured  while 
implementing  GSR  algorithm  for  image  enhancement. 


(d)  TIME 


Time  taken  for  enhancing  image 


Image  Data 


Fig.  13 : Average  speed  for  different  images 


This  graph  shows  the  time  taken  for  processing  an  image 
during  image  enhancement  and  it  shows  better  results. 


Comparison  for  Deblurring 


Fig.  1 6:  Comparison  between  existing  system  and 
proposed  system  on  the  basis  of  PSNR  values 

Deblurring  has  been  tested  for  12  Images  from  standard 
dataset  used  in  existing  scheme.  The  average  PSNR  value 
has  been  taken  from  all  12  images.  Final  Values  has  been 
compared  with  existing  scheme.  Proposed  model  shows 
the  better  results  in  comparison  of  existing  scheme. 

(C)  SPEED 


Evaluation  Measures  for  Deblurring 

(a)  PSNR 

PSNR  is  usually  expressed  in  terms  of  the  logarithmic 
decibel  scale.  The  signal  in  this  case  is  the  original  data, 
and  the  noise  is  the  error  introduced  by  compression. 
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Fig.  17:  Average  speed  for  different  images 


This  graph  shows  how  much  speed  is  measured  while 
implementing  GSR  algorithm  for  image  enhancement. 
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(d)  TIME 


Fig.  14:  Average  PSNR  values  for  different  images  in 
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Fig.  18:  Time  taken  for  different  images 
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This  graph  shows  the  time  taken  for  processing  an  image 
during  image  enhancement  and  it  shows  better  results. 

V.  CONCLUSION  & FUTURE  WORK 

In  this  paper  GSR  (Group  Based  Sparse  Representation) 
algorithm  is  proposed  which  is  based  on  concept  that 
group  of  patches  are  constructed  which  maintains  the 
relationship  among  various  patches  of  images  and  it  is 
implemented  for  three  image  restoration  problems  i.e.  DE 
noising,  DE  blurring  and  Image  enhancement.  Various 
parameters  are  taken  into  account  like  PSNR,  SSIM, 
speed  and  time.  In  Future,  this  research  could  be 
improved  for  fasten  the  results.  Working  upon  speed  for 
the  system  could  further  enhance  this  research/  technique. 
Also  this  research  could  be  further  implemented  on 
various  applications  for  image  restoration.  Now  the  GSR 
technique  has  very  slow  rate  for  image  restoration,  which 
takes  lots  of  time  to  produce  the  results.  This  technique 
could  also  be  designed  without  taking  the  original  image 
for  restoration. 
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